Journal of Research of the National Bureau of Standards 



Vol. 46, No. 1, January 1951 



Research Paper 2176 



Random Walks and the Eigenvalues of Elliptic 

Difference Equations 



Wolfgang Wasow 



This paper is concerned with the application of Monte Carlo methods to differential 
equations of the form, V^u-[-g{x,y)u = 0. It is shown that under suitable conditions the 
Monte Carlo solution converges and gives the solution of the difference analog of the above 
equation. 



I. Introduction 

1'lio aim of this paper is to describe and investi- 
p:ate a random walk procedure that can be used to 
appi-oxiniate the solutions of elliptic partial differen- 
tial ecjuations containino; the unknown function 
itself and not only its d(Tivatives. The method also 
leads to a scheme for the numerical di^lerminatioa 
of the lowest eigenvalu(^ of such diilerential (Hjuations. 

As a computational technicpie, our method is 
somewhat similar to the one used by Donsker and 
Kac [3] ^ for the calculation of the lowest eigenvalue 
of Schroedinger's equation, but the underlying 
theory is more elementary than the (h(H)rem on 
Wiener integrals of [4] used in I-') J. 

Like all computational methods l)as(ul. on random 
sampHng, those described in the present ])aper re- 
quire the use of a liigli-specMl calculating machine. 
Numerical tests are in pi'ogrc^ss. 

The random walks considered lead to dilference 
equations. By virtue of known results [1], [()], the 
solutions thus obtained are, for small step length, 
a])i)roximations to the corresponding solutions of the 
limiting differential equations. 

Let the symbol A dc^note the finite diflerence ana- 
logue of the Laplace operator, i. e., 

^y{^;y)=j^2 Mx+h,y) + u{x-h,y) 

+u(x,y+h) + u{x,y—h)-4u{x,y)]. 

Then we shall be concerned with the difference 
equation 

Au+g{x,y)u = 0, (1) 

where g{x,y) is to be sufficiently regular to guarantee 
convergence of the solutions considered to those of 
the corresponding differential equation. 

Everything that follows can be easily extended to 
more than two dimensions. Extensions to other 
elliptic differential equations are also possible. 

In the sequel, the word ''point", without further 
specification, is meant to refer to the points of a 
square lattice with mesh length h. 

1 Tho preparation of this paper was sponsored (in part) by the Office of Nuval 
Rcscarcii 

2 Figures in brackets indicate the literature reference at the end of this paper. 



II. Random Walk Procedure 

Let B be the interior of a finite domain whose 
l)oundary points form the set C. Consider the 
problem of finding the solution of eq 1 in 5 which 
assumes prescribed values f(S) at the points S of C. 
This problem will t)e shown to be I'elated to the fol- 
lowing random walk procedure. 

Let k{P) be a positive function defined in B, A 
I)article of mass 1 starts from an inner point P. 
I^efore moving to one of the four neigh])oring points 
Py, (i=l, . . . , 4), its mass is muHiphcul by the 
vahie of k{F) at P. Then it moves to a neighbor- 
ing point, all 4 points having the same probability 
/4 of being chosen. After a certain number of steps 
the particle arrives for the first time at the boundary, 
say at the point S. Consider now the random 
variable which is equal to the product of the mass 
u|)on arrival at the boundary by the value of /(P) 
at that point. We claim that, for ap])ropriatc 
choice of k{P), the expected value of this random 
variable — if it is finite — is the solution of eq 1 as- 
suming the values /■(S') on C. 

Li the (k^scription above, the infinite random walks 
which never I'cach Chave been ignorecL This is per- 
missible, since the total probability associated with 
such walks is zero, (see [1], p. 44). 

Without loss of generality we may restrict tb(^ chs- 
cussion to the special boundary values 



f{S) = S{R,S)^ 



1 for S = R 
for S^R 



(2) 



where R is some fixed arbitrary point of C. For, if 
we denote the expected value upon arrival corre- 
sponding to these special boundary values by ^(P, i?), 
then the expected value for any boundary function 
/(P) is S E{P,R) f(E). If /^J{P',R) is indeed the solu- 

ReC 

tion of eq 1 assuming the values 8{R,S) on the 
boundary, then it follows immediately that 
^I^J{P,R) f(R) is the solution with boundary values 

ReC 

fiS). 

Theorem 1: Set 



k{F)-- 



(i4*'«)"' 



(3) 
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and let h be so small that k(P)^0 in B, then the Junc- 
tion E(P,R) described above satisfies — ij it is finite — 
with respect to P the difference eq 1 and the boundary 
condition 2. 

Proof: Let {Ln{P,R)} be the set of all possible 
paths starting at P and reaching (7 at JS on the nth 
step. The probability of the particle moving along 
any such path is 4"''. Let mn(P,R) be the mass upon 
arrival corresponding to a given such path and write 



e„{P,R)=i-„ 2 m„{P,R) 



{i„(p,ij)j 



(4) 



the summation extended over all paths of {Ln(PjB)]. 
This quantity en(P,R) is the expected mass upon ar- 
rival on C, if only arrivals at R and on the nth step 
exactly are counted with their actual mass, and all 
other random walks ending on C are considered to 
contribute the mass zero. If we set 



then 



En(P,R) = ^e.{P,R) 



E{P,R):=\imEJP,R) 



(5) 



(6) 



provided the limit is finite. 

Let P;, = 1, • • • ,4), be the particular neighboring 
point of P reached by the particle at the first step, 
when following the particular path iw(P,i?); then 



mn{P,R).==k{P)mn-i{Pj,R), for n>0, 



(7) 



if mn-i(Pj,R) is the mass upon arrival at R corre- 
sponding to that path of the set {Ln-i{Pj,R)} which 
is part of Ln{P,R). From eq 4 and eq 7 we have 



en{P,R)=^nJ: S HP)m^UPj,R), n>0, (8) 
and, therefore, 

en(P,R) = '^j:en-,{Pj,R), n>0. (9) 
4 j=i 

By means of definition 5 this yields 

En{P,R)=^ i: E^_,{Pj,R) (10) 

4 ;-l 



or, upon passage to the limit, 

E(P,R) = '^±E{Pj,R). 
This is readily seen to be equivalent with 



AE+^^^E=OmB. 



(11) 



(12) 



For a boundary point S it follows from the definition 
oien(P,R) that 



eo(S,R) = 8{S,R) 



(13) 



if d{S,R) denotes the function which is for S^^R 
and 1 for S^R. For n>0 we have en(S,R) = 0. 
These facts and eq 12 lead immediately to the state- 
ment of the theorem. 

Remark 1. The function E{P, R) can be considered 
the finite analog of the normal derivative of Greenes 
function, since the solution that assumes the bound- 
arv values f{R) can be vratten in the form 
J^E(P,R)f(R) which recalls the formula 



ReC 



U^ 



L 



bG{P,R) 



fiR)ds 



from the theory of partial differential equations. 

Remark 2. It is well known that the probability of 
a particle leaving the domain B at a preassigned point 
R oi C satisfies the difference eq 12, if the particle is 
subject at each step to a probability of ^'dying" equal 
to 1 —k{P). The corresponding function g{P) is then 
everywhere nonpositive. In the next section it will 
be shown that the procedure of the present paper is 
applicable under considerably milder restrictions on 
g{P). A further advantage of our method is that at 
each step only one random decision has to be made 
and not two as in a random walk involving the possi- 
bility of dying. 

in. Validity of the Procedure 

The statement of theorem 1 includes the assump- 
tion that E(P,R) is finite. In this section we shall 
prove that this is the case, if and only if the eigenval- 
ues of Au-\-g(P)u in B are all positive. Here and in 
the sequel we mean by the eigenvalues of a linear dif- 
ference operator L[u] in the domain B those values of 
X for which the problem 

L[u]+\u = in 5, u = on C 

has a nontrivial solution. The eigenvalues in this 
sense are the negative of the eigenvalues of the matrix 
formed by the left members of the system of linear 
equations represented by L[u]=0 m B, u=0 on C. 
It will simplify our terminology if we call the negative 
of this matrix the matrix '^belonging to L[u].^^ 

The proof of the theorem mentioned requires some 
preparations. 



u are 



Lemma \: The eigenvalues of — Au-\-( ^— ti) 

the same as those of Au-\-gu. 

Proof: The matrix A belonging to 

Au + gu=0 in B, 



is of the form A = G-{-H. Here, G^ is a diagonal 

4 
matrix formed with the values of —g(P) +71^ {P in B). 



66 



The mnliix JJ lias in the row belonging to any ^ivon 
point J\ the clement — -p in every column corre- 
sponding to an interior neighboring point of P, and 
zeros (everywhere else. The matrix ^* of the sys- 
tem— A^+f ly— — j t6 = is, similarly, given by ^1* = 

G—JI. We may interpret these symmetric matrices 
as belonging to quadratic forms in the variables u{P), 
(P in 7^). In the space of these variables consider 
the orthogonal transformation which consists in re- 
placing the value of u{P) by —u{P) in every second 
point P and leaving u{P) unchanged in all the other 
points, in such a way that a point and its neighbors 
arc always treated differently. This can, e. g., be 
done bv set tins; 



u\P) = {- 



■lV''^'\iP) 



(14) 



where {;x,y) arc the coordinates of P. This orthogo- 
nal transformation changes the (juadratic form with 
matrix (7+ //into the one with matrix G—TL These 
two matrices have, therefore, the same eigenvalues. 

Now we define an analytic function (t)lP,R;r) of r 
bv 



<l>{PJi',r) = ^r^'e,XP,R). 



(15) 



We assume throughout that (/(/^X-p, and therefore 

k{P)y>0. To show that the power series in definition 
15 has positive radius of convergence consider the 
random walk problem in which ^(/^) has been replaced 
everywhere by max,^(P), and denote by <(P,/?) and 

PeB 

k'^(P) the quantities corresponding to en{P,R) and 
k{P) in this new problem. Then, by the definition 

oien{P,R), 

< e.,(P, R) < k'^'XP) pn{P, R) < /^* ' 

where pn{P,R) is the probability of moving along a 
path that leads in exactl}^ n steps from P to R. 
Henc(e, the radius of convergence of the. series in 
formula 15 is at least equal to 1/A**. 

The formula 15 may, of course, be hiterpreted as 
the finite analogue of a Laplace transform, applied to 
the solution en(P,R) of the ''parabolic" difference 
equation 9. Pursuing this analog^y, we find, by com- 
bining fornudas 9 and 15, for </> the elliptic difference 
equation 

4 



k{Act> + g<l>)-{- 



Hh 



-0. 



(16) 



Our function is that solution of the difference eq IG 
in B, which assumes the values d{P,R) on the l)ound- 
ary C. 

If we denote by r the diagonal matrix whose ele- 
nu^nts are the values of k(P) in B and by A the 
matrix belonging to A</)+^0, and if we set, for abbre- 



viation 



K>4)= 



X, then l\{ — \[ is the matrix 



belonging to the difference eq 1(). The solutions of 
eq 16 are rational functions of X and therefore of r. 
It follows from definition 15 that r=0 is not a pole of 
this rational function. 

For later use we mention that the poles of </> are 
simple. For if D is a matrix such that IP=V, we 
have TA-\I=D(DAD-\I)D-K Tlu) elements of 
the resolvent {DAD — \I)-^ of the symmetric matrix 
DAD have only simple poles (see, e. g., [7], p. 2()), and 
this property is not destroyed by the matrix trans- 
formation with the nonsingular matrix D. Hence, 
the elements of {TA — \I)~^ have only simple poles as 
functions of X, i. e., <^ has only simple poles as 
functions of r. 



Lemma 2. The number 



40-,^) 



IS an eigen- 



value of k{A(h+g<t>), if and only if r=ri is a pole of 
(t){P,R;r) for at least one pair of points P,R, 

Proof. If r=ri is a pole of </>(P,P;/') for some P 



and 



R thenyi ( 1 ) is a pole of some element of the 

resolvent of the matrix l)elonging to /^( A </)+.</</>). 
Hence, this number is an (Mgenvahie of that matrix. 

Conversel,y, let ^(l", ) ^^^ *^^^ eigenvalue of 

k{A(t)-r(](p) and. assume that (t)(P,R;ri) exists for all 
P and R. In order to show that this im|)lies a con- 
tradiction we make use of Green's formulas for the 
difference operator A?/. These formidas are (cf. [1]) 



B+C B C 



and 



B+C C 



-0 (18) 



where Ux, Uy, etc., denote the first forward diff(T(Mices 
and where the expression T{u) is defined as follows: 
if u assumes the value Uq at a given boundary point 
R and the values i^i, . . . , Uy{v:^?>) at the y neigh- 
boring points of P in /^+ C, then 



V{u)=^{u,-{- 



+u,— vii^. 



(19) 



Green's formulas 17 and 18 are valid for any functions 
that vanish outside of B-\-C. If we substitute in the 
identity 18 for v the function (t){P,R;ri) and for u an 
eigenvector U corresponding to tlie eigenvalue 

jtA 1— — V it follows that r(t7) = 0, identically for 

all boundary points R. Substituting U for u in the 
identity 17 we sec that the bilinear form 



X! ) UxVx+ UyVy 

B^C\ 



vanishes identically for any choice of the function v. 
Taking for v the function that is 1 at an arbitrary 
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interior point ^nd everywhere else, the identity 20 
is seen to imply for U the first order difference 
equation 

(21) 
Together with 

fc(A?7 + </L/)+^(l-J-)?7=0 

this yields 

hAU-U,-Uy = in B, U = on C, 
i. e. 

U{x-h,y) + U{x,y-h)-2U(x,y) = 0mB,U = 0onC. 

This last difference equation has the unique solution 
U=0 as can be seen, e. g., by calculating its values 
from point to point from the boundary inwards. 

Since U is, by assumption, not identically zero we 
have arrived at a contradiction, and the proof of the 
lemma is completed. We are now ready to formulate 
and prove our theorem. 

Theorem 2: // i7(P)<4 in B, then E(P,E) = 

lim En{P,R) is finite Jor all P in B and all R on C, if 

and only ij all eigenvalues of Au-^gu are positive. 

Proof: The difference expression k{Au-\-gu) is, in 
general, not self-adjoint, i. e. the matrix belonging to 
it is, in general, not symmetric. But its eigenvalues, 
i. e. the numbers X for which the problem 

Au+gu + \k-\P)u=0 in B, u=0 on C (22) 

has a nontrivial solution are positive if and only if 
those of Au+gu are. In fact, let A be the mptrix 
belonging to Au+gu and denote by D the diagonal 
matrix whose elements are the positive determina- 
tions of F^{P). Then eq 22 can be written in the 
form 



If we make the substitution 
u=Dv 
this is equivalent with 

DAI)v=\v, 



(23) 



Hence X is an eigenvalue of the symmetric matrix 
DAD and therefore real. If we write DAD' instead 
of DAD we see that DAD' is the matrix of the 
quadratic form obtained from the one whose matrix 
is A by the transformation 23. Since this trans- 
formation does not destroy the positive definite 
character of a quadratic form, and the same is true 
of its inverse, A is positive definite, if and only if 
all the eigenvalues of eq 22 are positive. 



By lemma 2, the eigenvalues of k{Au-\-gu) are all 

positive if and only if -p M — - j is positive for all 

poles of (j){P,B;r), i. e. if these poles are all greater 
than r=l, or negative. On the other hand, by the 
definition of 4>{P,E;r) the expected mass E(P,E;r) 
is finite, if and only if all poles of are numerically 
greater than 1. Our proof will be completed, if we 
show that the occurrence of negative poles greater 
than or equal to —1 implies the existence of non- 
positive eigenvalues of Au+gu. To show this we 

Q 

substitute X = X* + p into eq 22 and obtain, after a 
short calculation using the expression 3 for k{P), 

k[Au+ (t2-9) 'u] + X*^ = in B, u = on C, 

In view of lemma 1 and the first part of this proof, 
the existence of nonnegative eigenvalues X* is 
equivalent with the existence of nonpositive eigen- 
values of Au+gu. On the other hand, X*=0 means 

X>Ti and by lemma 2 such a X is an eigenvalue of 

k (Au+gu), if and only if (j){P,B;r) has a pole in 
— l<r<0. This completes the proof. 
Corollary: If 

g{P) = p-V{P) 

where p is a parameter, lim En(P, E) exists, if and 

only if p is less than the lowest eigenvalue of An— 
V{P)u. 

Proof: The eigenvalues of Au—V{P)u are obtained 
from those of Au+(p~V{P)u by subtracting p. 
Therefore the eigenvalues of the latter expression are 
positive, if and only if those of Au—Vu exceed p. 

IV. Practical Bound for Validity of Random 
Walk Procedure 

If the method described in the preceding section is to 
be used, we have to be sure that the condition of 
theorem 2 is satisfied. Since the eigenvalues are, in 
general, not known, the following sufficient criterion 
may be useful. 

Theorem 3: The expected value E{P, E) exists, if in B 



ii(p><^ 



(i:^+i)-^*-|^ 



12 



(h^i^) 



(24) 



where a and b are the sides of the smallest rectangle 
with sides parallel to the axes that contains B. 

Proof: We substitute for the problem defined by 
formulas 1 and 2 the similar problem obtained by 
replacing g{P) everywhere by its maximum y in B, 
by replacing the domain B by the circumscribed 
rectangle 8^ with sides a and 6, and finally by im- 
posing the boundary condition: u^^l on the boundary 
Ci of Bi. Consider the mass upon arrival anywhere 
on C] for this new problem. Its expected value, 
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Ei{P) — if it is finite — is at least equal to the expected 
value E{P, R) of the original prohlem, and it solves 
the modified difl'erence equation problem. 

Fiom tli(H)rein 2 we know that Ei{P) is finite, if 
Au+7t/ — has only positive eigenvalues correspond- 
ing to the domain Hi, i. e. if the smallest eigenvalue 
P] of Au = i) exceeds 7. 

The eigenvalues pj of At/ = in a rectangle can be 
calculated in literal analogy to the familiar procedure 
for the Laplace equation. (See [2], p. 258). They 
turn out to be the values of 



(snr 



lirh 
2a 



+sin' 



mirh 



I-- 



1,2,...,^-1 



m=l, 2, . . ., j^-l 



Setting l—m=l and increasing the expression by 
substituting the first two terms of the power series 
for the sines the proof of our theorem is at hand. 

V. Green's Function 

Using the procedure and the notation of the pre- 
vious sections let gn{P, Q) be the expected amount of 
mass that passes through an inner point () on the 
77-th step of a walk that starts at P and ends on the 
boun(hiry C. Clearly, 

f/o(/^ Q)= KP^ Q). (ln{h\ Q) = 0^ (//>0), H on (\ (25) 
The diflei'ence e(iualion 

g.(P, Q) = ''-P i: ih>-dPj. Q). n>0 (26) 

for g„{P, Q) is derived precisely like its analog, eq 9. 
If wc set 



and 



Gn{PJd = i:ih(P,Q) 



G(P,Q)= Vim GniP.Q), 



(27) 
(28) 



then G{P, Q), if it is finite, solves the problem 
4 



Au + g{P)u-- 



'h'HP) 



8{P,Q) in B, u = on C (29) 



which corresponds to eq 12. When there is no indi- 
cation to the contrary the symbol A is always meant 
to operate on the point P. 
The solution of 

Au + gu+J{P) = in B, u = on C (30) 

can be written in the form 

u{F)=~^G{P,Q)k{Q)M)- (31) 

4 r,eB 



In analogy with the terminology for differential 
equations we shall call the function 



K{P,Q)=^k{Q)G{P,Q) 



(32) 



Green's function for our difference equation and the 
domain /?. 

The following experiment leads to a random varia- 
ble whose expected value is u{P) provided G{P,Q) is 
finite. 

On every step of the random walk multiply the 
amount of mass at the instant by the value of 
k{Q) f{Q) at that particular point and add the prod- 
ucts thus obtained. If the cumulative sum after A^ 

random walks starting at P is multiplied by j^> we 

have an estimate of u{P). 

As to the existence of G(P,Q) we have a theorem 
analogous to theorem 2. 

Theorem 4: Ij g{P)<$-^ in B, then lim Gn(P,Q) is 

Unite for all P and Q in B, if and only if all eigen- 
values of Au-{-qu in B are positive. 
Proof: Define xP{P,Q; r) by 



71 = 



(33) 



The convergence for sufficiently small ir| is shown 
exactly as in the case of the function </)(P, /?;/). 
From formulas 25 and 26, \p is seen to solve the 
problem 



k{^^P-\-g^P) + . 



.H>- 



I'r 



5{P,Q)\uB,4' = OonC. 
(34) 



r anc 



It is therefore a rational function of /'. The poles of 

id the eigenvalues -^ f 1—- j of k{l^yp + g\p) are 

shown to correspond to each other, just as in the 
proof of lemma 2. The reasoning is somewhat sim- 
pler here, since instead of r(r') = we obtain here 
immediately ^U{P)8{P,Q) = 0. If this is true for 

PeB 

all Q in B, it follows that U(P) = and the contra- 
diction is at hand. The subsequent reasoning is 
precisely the same as for theorem 2. 

VI. Random Walks in Unbounded Domains 

If B is an unbounded domain other than the full 
plane, then the quantity/t'(P,7?)may still exist. The 
function G(P,Q), on the other hand, and its proba- 
bilistic interpretation may exist even in the full plane. 
We limit ourselves, therefore, to a discussion of this 
latter quantity. 

Some facts from the theory of infinite matrices will 
have to be used. For convenience we summarize all 
the definitions and properties used, and add refer- 
ences to the corresponding pages of [7]. 



(a) If A={ai}c}, {i, k=l,2, ' ' •), is an infinite 
matrix, the finite matrices Aj obtained from A by 
letting i and k run from 1 to j only are called the 
segment matrices of A, (p. 121). The set consisting 
of all eigenvalues of all segment matrices and their 
accumulation points is called the segment spectrum 
of A, (p. 124). 

(b) An infinite vector Xt, {i=l, 2, • • • ) is called 

00 

quadratically convergent, if XI l^^l^ is finite, (p. 125). 

i = l 

(c) An infinite matrix is called bounded, if 
there is a constant M independent of n such that 

12 \Xi\'- i:\yi\MvA24). The 

product of two bounded matrices exists and is 
bounded, (p. 131). For the multiplication of 
bounded matrices the associative law is true, (p. 131) . 
If the segment matrices are normal, i. e., if Aj A] = 
Aj Aj, then A is bounded, if and only if its segment 
spectrum is bounded, (p. 124). 

(d) An infinite Hermitian matrix is called positive 
definite, if there is a positive constant ju, independ- 
ent of n, such that for all Xi 



\i,k = l / 



Zi aaXiXk<[j. X) \Xi\^^ (p. 124). 

i, fc = l i=l 

It is called nonnegative definite, if 

n 

y^, aifcXiXk>0, for all n and all Xf, (p. 124). 

i,k = \ 

CD 

(e) If there exists a constant C such that ^ |aa| 

/c=l 

<C,'i2 WkiKC, (^=l, 2,.-.), then the infinite 

k = l 

matrix A = (ai)c) is bounded (p. 153). 

(f) If A is bounded and normal, then it possesses 
a bounded inverse if and only if A A' is positive 
definite (p. 138). 

(g) If A={a^]^ is positive definite, then it possesses 
a bounded inverse A~^ = {ai)^ and, if A~^ = {ai'^) is 
the inverse of the segment matrix A^, then 



OLik'- 



=lim a^^ for all i and A:, (p. 229). 



(h) If A^ is positive definite and A is nonnegative 
definite, then A is positive definite. 

The definitions at the beginning of section 4 can 
be applied without significant change to an un- 
bounded domain. 

Let the points of the domain be numbered in such 
a way that the first j points form, for every j, a 
simply connected domain Bj of lattice points. If 
the expected value G{P,Q) is finite for a given pair 
of points P and Q, then the expected value G^^^{P,Q) 
exists for the corresponding random walk problem 
in all those domains Bj which contain P and Q, i. e., 
for all suflSciently large j. One has, furthermore, 



We shall call the expression /lu-\-gu positive 
definite, if the real and symmetric infinite matrix A 
belonging to it is positive definite. In this matrix 
the rows and columns will always be assumed to be 
arranged in the order of the numbering of the points 
of B which was described above . (But the positive 
definite character of an infinite matrix is, of course, 
not destroyed if the rows and columns are subjected 
to the same rearrangement.) 

Theorem 5: Ij Au+gu is positive definite in the 

4 
unbounded domain B, and. ij g{P)<-r-2 ^^ ^y ^^^'^ ^^^ 

expected value G{Pj Q) exists. 

Proof: Since Au-\-gu is positive definite in B, it is 
a fortiori positive definite in all domains Bj. The 
matrix belonging to Au-{-gu in Bj is the segment 
matrix Aj of A. By theorem 4, the expected value 
G^^^ (P, Q) is finite, — provided P, Q are points of 
Bj — , and solves problem eq 29. Denote by Aj (P, Q) 
the elements of the matrix Aj in the row and column 
corresponding to P and Q, respectively, and by 
^(-1) ^p^ Q^ ^Yie corresponding element of the inverse 
matrix. Then 

H SeB, 



From this equality we conclude, by virtue of relation 
35, and of the property {g) stated above, that 
O {P,Q) exists and is given by 



YimG^^\P,Q) = G{P,Q). 



(35) 



G{P,Q)=^,A- 



'KP,Q)k-\Q) 



(36) 



where A^'^^P, Q) are the elements of the matrix 
A-\ 

Corollary: If, in addition to the assumption of 
theorem 5, it is known that ^(P) > const. >— oo in. B^ 
then G (P, Q), as an infinite matrix, is bounded. 

Prooj: For then, 0< k'^ {Q)< const. < oo in B, 
and the right member of eq 36 defines a bounded 
matrix, since yl~Ms bounded by virtue of (g). 

Theorem 6: Ij G{P, Q) exists jar all P and Q, then 
An + gu is nonnegative definite. 

Prooj: If G{P, 'Q) is finite, so are all G^^^{P,^ Q), 
and therefore all segment matrices Aj are positive 
definite by theorem 2, hence A is nonnegative 
definite, by definition {d). 

Theorem 6 cannot be strengthened to a full con- 
verse of theorem 5. This can easily be seen from 
the following example. Let g{P) be zero, so that 
k{P) = l and eq 1 reduces to Ai/=-0. Then G{P, Q) 
is simply the expected number of visits at Q for a 
moving point starting from P and being absorbed 
as soon as it meets the boundary C for the first 
time. This quantity is known to be finite for an 
infinite quadrant but infinite for the whole plane 
(see [5] ), although An is semidefinite in both these 
domains, in consequence of the results of section 4. 
But the following weaker statement can be proved. 
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Theorem, 7: Asfiume that G{P, Q) exists and is a 
bounded infinite matrix. If then g{P) satisfies in 
the unbounded domain B the inequality 



g{P)-- 



A 
'-h^' 



(*>o) 



057) 



then Ai/ + gu is positive definite in B. 

Proof: If (r{P^ Q) exists then it satisfies the dif- 
ference equation 29 in B, i. e., if A{Pj Q) are the 
elements of A, 



S A{P, S)G{S, Q)=^, S{P, Q)k-'(P). 

In other words, if T denotes the infinite diagonal 
matrix formed with the elements k{P) and O de- 
notes the infinite matrix with elements O (P, Q)^ then 



The matrix A 



h^ . . . 

-r ^r is a I'idit inverse of A. 

bounded, thanks to assumption :>? and projXMty (e). 
Since F is bomided, because of assumption IH, the 

h^ 
matrix — OV is bounded in consequence of proper- 
ty (e). Thus, A is boujided and normal (even 
symmetric) and possesses a bounded invcM'se. There- 
fore, A^ is positive definite by propcM-ty (/), and 
property (h) assures the positive definitene'ss of A 
itself. 

Remarks: In view of the facts mentioned after the 
proof of theorem 6, it follows from theorem 7 that 
the expected number of visits at a point Q during a 
random walk starting from a ])oint P of an infinite 
(juacb-ant forms an infinite nnitrix that is unbounded. 

VII. Sampling Method for Calculation of 
Lowest Eigenvalue 

The fact that the i-adius of convergence of the 
functions </> of fonnuhi 15 and \l/ of fornuila 33 de- 
termine the lowest eigenvalue of k{Au-^gu) can be 
used for an approximate experimental determination 
of tliis (Mgenvalue. This gives us an approximation 
to the lowest eigenvalue of the diH'ercMitial expression 

^2/5/ ^^U 

s— 2+^— 2+^'^ i^ the domain B or in any domain B^ 

bounded by a piece wise smooth curve C and con- 
taining in its interior the same lattice points as B. 
For k a])proaches 1 as fast as A^, as /i -^ 0, and the 
eigenvahies of Au-]-gu approach those of tlie cor- 
responding dift'erential equation, (cf. [1]). 

The following lemma is needed for the subsequent 
(Uscussion: 

Lemma 3: The poles of the function (l){P,R;r) (and 
also those of i/'(P,Q;r)) lie symmetrically with respect 
to r=0. This is equivalent to the statement that 
the eigenvalues of k(Au-^gu) lie svmmetricallv with 

4 ' * 

respect to ^^t2' 

Proof: The argument applied in the proof of lenuna 
Mo 1 he matrix A belonging to Au-^gu can be literally 



extended lo the matrix DAI) of the proof of theorem 
2, with the i-esult that the eigenvalues of k{Au-[-gu) 

are the same as tliosc^ of —k Au-{- 1 f/ — -p )^ ' ^^^^ 

in the proof of theorcFu '2 i( wns jdso sliowji that, 

if X is an (ug(Mivahi(^ of k{Au-i-gii), then t^— X i^ *in 

eigenvalue of — ^ ^^+( i'/— ti^ W r Combining 

these two facts the proof of the second statement of 
our lemma is at hand. The first statement is 
equivalent to the second by virtue of lemma 2. 

We first discuss the use of the function </> for our 
purpose. The numerical computations will be 
simpler if, instead of operating with </> dh'cctly, the 
function 

4>*(P,r)=j:4>ir,R;r) 

BeC 

is used. If we define e*(P) by 

el:{P)=j:e,.(P,H), 

BeC 



then fornnda 15 implies 

</>*(P)-i]r"c:(F). 



(38) 



The function </)*(/^) satisfic^s th(^ diffcM-cMice equation 
16 in /) and assumes the boundary value 

Let Xi be the lowest eigenvahie of k{Au-\-gu). By 
lemma 2 and lenuna 'A tlie la.dius of convergence of 
(t>(P,R;r) is then 



H^-'i^')"- 



The radius of convergence of (/)*(P,r) is, in general, 
also ri. Exceptionally, it may be larger, owing to 
cancellation of poles in the sum Xj 4>{^^J^',^)' Iii 

ReC 

this case the method to be described would lead 
to some higher, rather than to the lowest eigenvalue. 
If this is suspectcul, the result may be checked by 
repeating the computations with a different P or 
with formula 15 directly. We shall exclude this 
case from our considerations. 

The quantity 6*(P) is the expected mass upon 
arrival anywhere on the bounchiry for random walks 
starting at P and consisting of exactly n steps. By 
performing a sufficient number of random walks 
starting at P those 6*(P) for which n is not too large 
can be estimated experimentally. 

In order to find /i from these data we recall that 
0*(P) is a rational function whose poles are real 
and symmetric with respect to the origin. Henc(\ it 
is of the form 

v<Ni2 \_r~>\ I -r>\ J 
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Here, A^ is the number of points in B. For even A^ 
the quantity di{P) is zero. c^{P) is, by assumption, 
not zero for the point P chosen. From formulas 38 
and 39 we find 



erXP)= S r-[c.{P) + {-\Ye^XP)]^ (/7>2). 

v<NI2 

If n is not too small, we can write, with sufficient 
approximation, 

et{P)^rr [cm+{-\yc_,{P)l 



1. e., 



r\^et{P)leU2{P\ 



By using several values of n, the estimate of r can 
be improved, and at the same time the admissibility 
of the approximation used is tested. The lowest 
eigenvalue is then given by 



Xk 



The function ^ of section 5 can also be used to 
compute Xi. One defines iA*(^, r) and gt{P, r) by 



and 



QeB 



(itiP) = 12.(1 n{P,Q;r). 

QeB 



Then 4'*{P,r) = t2>'"9*.{P). gtiP) is the expected 

mass anywhere in B at the nth step of a random walk 
starting at P. This quantity can be found experimen- 
tally by performing a suflicient number of random 
walks starting from P, and recording the mass at every 
step. The sum of all recorded masses for the nth 
step divided by the total number of walks performed 
is an approximate value for gt(P). From thereon 
the procedure is exactly like the one described for 

If the domain B is unbounded, the concept of the 
lowest eigenvalue has to be replaced by that of the 
left endpoint of the spectrum, which may, of course, 
be at — 00 . We limit the discussion to cases in which 
the spectrum is bounded from below. 

Since no experimental method can take into ac- 
count random walks beyond a certain length, all 
experiments take place in some finite subdomain 
Bj of B, so that we must answer the question whether 
the results thus obtained approximate the correct 
values for the given unbounded domain. This 
question is answered affirmatively by the theorem 
that the left endpoint of the segment spectrum 
coincides with the left endpoint of the spectrum, 
provided the matrix is half bounded and symmetric 
([7] p. 231). 



VIII. Comparison with Method of Donsker 
and Kac 

In this section we shall assume that we are dealing 
with a one dimensional problem. This will enable 
us to add a few heuristic remarks on the relationship 
between our method and that of Donsker and Kac, 
[3], without introducing notational complications. 

Let Xj be the position of a point at the jth step of 
a random walk in a linear net of mesh length h. The 
particle is supposed to start from x = () and to be 
equally likely to choose either of its two neighbors at 
each step. Then Xj is the sum of j identically and 
independently distributed random variables with 
mean and standard deviation h. Donsker and Kac 
are primarily concerned with the limiting distribution, 
as A— >0, of a random variable which, in our notation, 
can be written (our g(x) is — 21/(j') in their notation) 

a(h,t)=~ ^gixi). 

^ .i<t/h- 

Here t is an arbitrary positive parameter. 

The quantity .^* (P) of section 7 is, in one dimen- 
sion and for P=0, the expected value of the random 
variable 

y{h,n)=Uk{xj)= n (l-^ g{x)^ ' 

j<n j<n \ -^ / 

For small A, and with 

we have, approximately, 

7(A,n)-'e-«^^'\ (40) 

Our function \l/*{P,r) of section 7 is the expected 
value of the random variable 



23r^7(^,^). 

w = 



With the substitution 



r=^e 



(41) 



(42) 



and using relation 40 it is seen that, approximately 
for small A, 

n=0 1^ Jo 

If a(h,a,t) is the distribution function of a{h,t), we 
have, therefore, 

r{P,r)^l-,j^^ j\-''''^-''dMh,t). (43) 

On the other hand,i/'*(P,r) satisfies a difference 
equation problem which differs from eq 34 only in 
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that (1h* factor 8(P,0) in the right member is to be 
rephi('(Ml by 1 and th(^ faetors 4 by 2. This last ehange 
is iiec(^ssary l)(M'aus(^ we are deahng now with the one- 
dimcMisioiial probh'm. Because of eq 42 we may 
write for small ft, 



1 ^ —s h^, f^ 1. 

r 

Furthermore, ^'^1, and the difference equation may 
be replaced by the corresponding differential equa- 
tion. With these changes, we obtain from the differ- 
ence (Hjuation 34 the differential problem 



j^^+((j-2s)u+j^=0 inB, 



-QonC, (34*) 



whose solution will be approximately \l/*. In the 
paper by Kac B is the whole line. In this case, the 
solution of eq 34* at a^-^O can be written in the form 



-m: 



X (x) dx 



(44) 



where xUO is Green's function on the whole line for 
the differential equation 



1 d'u 



2 dx 



2 + 



(H 



u=0. 



(45) 



For small h, the left members of eq 43 and 44 are 
approximately equal. If we denote by <T(a,t) the 
limit of the distribution function a(h, a, t), as h-^0, 
it seems therefore plausible^ that the identity 






UL(j{aJ)dt-- 



j: 



■,{x)dji 



(46) 



will hold exactly. This identity, proved by Kac hi 
[4], is the theoretical basis of the method of Donsker 
and Kac in [3]. 

In [4] the passage to thc^ limit, as h-^i), is essiMitial, 
since that paper is concerned with tlie distribution 
of certain Wiener integrals. The samj)ling nu^thod 
of [3] operates, of course, with finite sums only. The 
methods of [3] and those of tlu^ prc^sent papeu* are 
therefore closely related. In order to be sure that 
the results obtained approximate those for the corre- 
sponding differential equation we refer to [1]. The 
analogous part of Kac's theory in [4] also makes use 
of the methods of [1]. 

Dated: March 21, 1950. 
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